Event temporal relation extraction with attention mechanism and graph neural network

نویسندگان

چکیده

Event temporal relation extraction is an important part of natural language processing. Many models are being used in this task with the development deep learning. However, most existing methods cannot accurately obtain degree association between different tokens and events, event-related information be effectively integrated. In paper, we propose event integration model that integrates through multilayer bidirectional long short-term memory (Bi-LSTM) attention mechanism. Although above scheme can improve performance, it still further optimized. To performance previous scheme, a novel relational graph network incorporates edge attributes. approach, first build semantic dependency parsing, considers edges' attributes by using top-k mechanisms to learn hidden contextual representations, finally predict relations. We evaluate proposed on TimeBank-Dense dataset. Compared baselines, Micro-F1 scores obtained our 3.9% 14.5%, respectively.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Neural Temporal Relation Extraction

We experiment with neural architectures for temporal relation extraction and establish a new state-of-the-art for several scenarios. We find that neural models with only tokens as input outperform state-ofthe-art hand-engineered feature-based models, that convolutional neural networks outperform LSTM models, and that encoding relation arguments with XML tags outperforms a traditional position-b...

متن کامل

Neural Relation Extraction with Multi-lingual Attention

Relation extraction has been widely used for finding unknown relational facts from the plain text. Most existing methods focus on exploiting mono-lingual data for relation extraction, ignoring massive information from the texts in various languages. To address this issue, we introduce a multi-lingual neural relation extraction framework, which employs monolingual attention to utilize the inform...

متن کامل

Attention-Based Convolutional Neural Network for Semantic Relation Extraction

Nowadays, neural networks play an important role in the task of relation classification. In this paper, we propose a novel attention-based convolutional neural network architecture for this task. Our model makes full use of word embedding, part-of-speech tag embedding and position embedding information. Word level attention mechanism is able to better determine which parts of the sentence are m...

متن کامل

Anomaly-based Web Attack Detection: The Application of Deep Neural Network Seq2Seq With Attention Mechanism

Today, the use of the Internet and Internet sites has been an integrated part of the people’s lives, and most activities and important data are in the Internet websites. Thus, attempts to intrude into these websites have grown exponentially. Intrusion detection systems (IDS) of web attacks are an approach to protect users. But, these systems are suffering from such drawbacks as low accuracy in ...

متن کامل

Neural Relation Extraction with Selective Attention over Instances

Distant supervised relation extraction has been widely used to find novel relational facts from text. However, distant supervision inevitably accompanies with the wrong labelling problem, and these noisy data will substantially hurt the performance of relation extraction. To alleviate this issue, we propose a sentence-level attention-based model for relation extraction. In this model, we employ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Tsinghua Science & Technology

سال: 2022

ISSN: ['1878-7606', '1007-0214']

DOI: https://doi.org/10.26599/tst.2020.9010063